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Abstract 

We propose a new scheme for the long time approximation of a diffusion when the 
drift vector field is not globally Lipschitz. Under this assumption, regular explicit 
Euler scheme -with constant or decreasing step- may explode and implicit Euler 
scheme are CPU-time expensive. The algorithm we introduce is explicit and we 
prove that any weak limit of the weighted empirical measures of this scheme is 
a stationary distribution of the stochastic differential equation. Several examples 
are presented including gradient dissipative systems and Hamiltonian dissipative 
systems. 
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1 Introduction 

We consider the following stochastic differential equation 

dx t = b(x t )dt + a(x t )dB t , x(0) = x G M. d , (1) 

where b : M. d — > IR d is a locally Lipschitz continuous vector field and a is locally 
Lipschitz continuous on IR d , with values in the set of d x m matrices and B 
is an m-dimensional Brownian motion. Assume that (x t )t>o has a Lyapounov 
function V i.e. a positive regular function decreasing along trajectories (precise 
conditions are given by Assumption 1 in Section 2), so that there exists at least 
one invariant measure. 
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Until recently, the approximation of the stationary mode of the diffusion has 
been studied under the assumption that V is essentially quadratic i.e. 



\\JV\ 2 = 0(V) and sup || D 2 V || < +00, (2) 

x£R d 

and \b\ 2 = 0(V) (which implies sublinear growth for b). When a is bounded 
and the diffusion is uniformly strictly elliptic, the invariant measure v is unique 
and Talay proposed in [l^l a method for the computation of v based on the 
constant step Euler scheme. He proved the convergence of the invariant mea- 
sure of the scheme to v. On the other hand, Lamberton and Pages studied in 
the ergodic properties of the weighted empirical measures (v%) n >o of a de- 
creasing step Euler scheme. They proved the almost sure tightness of (^) n >i 
and that any weak limit is a stationary distribution for the diffusion. 

However, the conditions (2) and \b\ 2 = 0(V) are too restrictive for studying 
systems used in random mechanics (see Soize [Hj). Indeed, the drift vector 
field b is generally locally Lipschitz and in many cases V is not essentially 
quadratic. This framework has been recently investigated by Talay in [l3j 
and by Mattingly et al. in [9|. In these papers, implicit Euler schemes with 
constant steps are used for the approximation of the diffusion. In recent work, 
Lamba, Mattingly and Stuart have introduced on finite time interval [0; T] an 
adaptive explicit Euler scheme (see 0] and 0]). The step is adapted according 
to the error between the Euler and Heun approximations of the ODE x = b(x). 
They prove strong mean-quadratic convergence of the scheme on over finite 
time intervals and ergodicity when the noise is non-degenerate. We propose a 
completely different explicit scheme based on a stochastic step sequence and 
we obtain the almost sure convergence of its weighted empirical measures to 
the invariant measure of (1). 

The key to prove the almost sure tightness of the weighted empirical measures 
of the decreasing Euler scheme (X n ) n > introduced in 5i] is that the scheme 
satisfies a stability condition i.e. there exist at > and (3 > such that 



E 



V{X n+1 )\F n \-V(X n ) r s „ 

<-aV(X n )+/3, (3) 



7n+l 

where (7 n )n>o is the deterministic decreasing step sequence. Without assump- 
tions (2) we can no longer prove the stability condition (3) for this scheme. 
Our scheme is built in order to satisfy (3). We proceed as follows. Firstly, we 
start from a deterministic Xo = xq G M. d and set 

X n+1 = X n + % +1 b(X n ) + \J%+iO-(X n )U n+ i, n>0, (4) 

where (Z7 n ) n >i is a M m -white noise more precisely defined in Section 2 and 
7 n+ i = 7 n+ i A Xn with (7„)„>o a positive nonincreasing sequence and Xn a 
o~(Ui, . . . , U n ) -measurable random variable. 



2 



The basic main idea is to choose \ n small when the scheme starts to explode. 
In this case the discretization is finer and the stability condition of the diffusion 
prevents the explosion. Furthermore we prove that the scheme satisfies a sim- 
ilar condition with (3). A non-optimal -although natural- choice for \ n may 
be Xn = "Opvr ^ or ^ e ^ wo s^died examples, optimal choices depend on 
the Lyapounov function (see (29) and (53)). 

A crucial feature of our algorithm is the existence of an almost surely finite 
time rii such that for every n > nx, 7W = 7n i-e. the event {Xn-i < In} does 
not occur any more. 

Numerically the algorithm is very simple to implement and the complexity is 
the same as that of a regular Euler scheme. Another interest is that the scheme 
is explicit, which is a big advantage on implicit schemes for high dimensional 
problems. Indeed a fixed point algorithm is not needed is our case. Moreover, 
we will see that wrong convergence problem due to fixed point algorithm may 
be avoided using our algorithm. 

The paper is organized as follows. We introduce the framework and the algo- 
rithm in Section 2. In Section 3 are presented some preliminary results about 
the approximation scheme of (X n ) n >o defined in (4). In Section 4 we extend 
some results of (H and give conditions for the almost sure tightness of the 
empirical measure and for its weak convergence to an invariant measure of 
(1). Section 5 is devoted to the study of monotone systems and Section 6 of 
stochastic Hamiltonian dissipative systems. The numerical experiments are 
in Section 7 including some comparaison with recently introduced implicit 
scheme. We confirm the non-explosion and the convergence of the scheme. 



2 Framework and algorithm 

We will denote by A the infinitesimal generator of (1). The following assump- 
tion will be needed throughout the paper. 

Assumption 1 There is a C 2 function V on M. d with values in [1, +oo[ such 
that lim V(x) = +oo and satisfying 

\x\— >+oo 

3a >0, 3(3 >0, ( W, b) < -aV + (3, (5) 
3CVv > 0, 3a G (0, 1], Tr(V(Wf V) < C V ^V 2 ~\ 



and 3C>0, sup Tr(a*D 2 Va) (x) < C sup Tr(a*a)(x). {b) 
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Remark 1 IfV is essentially quadratic (i.e. satisfies (2)) then (6) is satisfied 
as soon as there exists C a > and a G (0, 1] such that Tr(cr*o~) < C a V 1 ~ a . 

Under this assumption, there exists a global solution to equation (1) and 
(at least) one invariant measure. An important point to note here is that all 
invariant measures have exponential moments. Indeed, an easy computation 
shows that for all A < — 4* — we have 

3a > 0, 3/3 > 0, Aexp(\V a ) < -aexp(\V a ) + 0, 

and this implies v(exp(\V a )^ is finite for all invariant measures v. 

For the approximation of the diffusion, we assume that (£7 n )n>i is a sequence 
of i.i.d. random variables defined on a probability space (Q, St, P), with values 
in M m , and such that U\ is a generalized Gaussian (see Stout [ill ]) i.e. 



3k >0, W9eR d , E exp( (0, U\) ) <exp(^^). (7) 



k\6 



and that var(CTi) = Id m . We will call (U n ) n >i a R m -valued generalized Gaus- 
sian white noise. The condition (7) implies that U\ is centered and satisfies 



3r > 0, E 



exp 



< +oo. 



Moreover, the condition var(Ui) = Id TO implies that k > 1. In the sequel, 
T n denotes, for n > 1, the cr-field generated on f2 by the random variables 
Ui, . . . , U n , and T§ the trivial cr-field. 

Remark 2 T/ie assumptions made on the white noise (Z7 n ) n >i ore not restric- 
tive for numerical implementation. Indeed, centered Gaussian and centered 
bounded random variables satisfy (7). 

The stochastic step sequence 7 = (7„)„>o is defined by 

Vn > 1, % = 7„ A Xn-i, 7o = To, (9) 

where (7 n )n>o is a deterministic nonincreasing sequence of positive numbers 
satisfying 

lim7 n = and ^ln = +00, 

n n>0 

and (xn)n>i is an (jF„) n > -adapted sequence of positive random variables. It 
is important to note that the step sequence 7 is (T n ) n >Q-predictable. 

Now we introduce the weighted empirical measures like Lamberton and Pages 
in 0. Given a sequence r\ = (n„)„>i of positive numbers satisfying J2 n >i Vn = 



4 



+00, we denote by the random probability measure on M defined by 

n n 

u n = jrY, VkSx k _, , with H n = Y; ^k- 

Un k=l k=l 

Throughout the paper, |.| denotes the Euclidean norm and |.| denotes the 
natural matrix norm induced by |.| i.e. for every square matrix A, \\A\\ = 
sap\ x \ =1 \Ax\. The letter C is used to denote a positive constant, which may 
vary from line to line. 



3 Preliminary results 



In this section, we prove results which are the keys to study the Euler scheme 
with predictable random step defined in the introduction. Proposition 3 con- 
tains two results: the first one (11) provides a substitute for the L p -bounded- 
ness of (V(X n )) n > used in [5|. The second one (12) is a new consequence of 
the stability condition (10) and is used to prove the fundamental proposition 
5 which ensures the existence of an almost surely finite time n\ such that for 
every n > n x , % = 7 n . 

Proposition 3 Let W be a nonnegative function and (7 n )n>o be a (J 7 n )n>o^ 
predictable sequence of positive and finite random variables satisfying: there 
exist a > 0, (3 > 0, n 6 N, such that 



Vn > no, 



E 



W(X,, 



n+lj 



T 



-W{X„ 



7n+l 



< -aW{X n ) + (3. 



(10) 



Suppose (9 n ) n >i is a positive nonincreasing sequence such that E J2n>o^n1n 
is finite, then 



E J2 9n%W(X n ^)\r no 
n>no+l 

//, in addition, lim n 6 n = then 



< +oo. 



'ID 



\im6 n W{X n ) = a.s. 



(12) 



The above_proposition is related to Robbins-Siegmund's theorem (see Theorem 
1.3.12 in [l| and the references therein). 



n 

Proof. Let R n = 9 k% and = \imR n e L X (P). 

k=0 
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We consider the sequence (Z n ) n > no defined by 

> n , z n+1 = z n + e n+1 (w(x n+1 ) - W(X n 



9n W(X n 



We first prove that for every n > n Q , Z n > 0. Indeed, an Abel transform yields 
for every n > n , 

n-l 

Z n =Y. 0k+i(w(X k+1 ) - W(X k j) + 9 no W(X no ), 

k=no 
n-l 

= E (°k - o k+1 )w(x k ) + e n w{x n ). 

k=no 

The sequence (6 n ) n >o is nonincreasing and the function W is nonnegative, 
then {Z n ) n > no is positive. 



Let (S. 



n)n>riQ 



denote the process defined for every n > no by 



S n = Z n + a E 0k%W(X k . x )+p(E[R oo \F n 



Rnj- 



k=no+l 



Since E \T n — R n > 0, the sequence (S n ) n > no is nonnegative. Moreover, 
as W satisfies (10) we have 

\/n > no, E[Z n+ i | .F n ] < Z n - a9 n+1 % +1 W (X n ) + p6 n+1 % +1 . 

Then it follows from this and from the J-^-measurability of 7«+i that 

\/n > n , E S n +i | T n < S n . 

Thus (S n ) n >o converges a.s. to a nonnegative finite random variable S^, and 
we have 



E 



E 9nlr,W(X n _ 1 )\F nQ 
n>no+l 



< +oo. 



From the almost sure convergence of (S n ) n > no , we also deduce the almost sure 
convergence of the series 



J29n(w(X n )-W(X n ^ 



n>l 



Since (0 n ) n >o is nonincreasing and converges to 0, Kronecker's lemma implies 
the almost sure convergence of (e n w(x n )) n>Q to o. □ 

Remark 4 A substitute for the LP -boundedness of {V(X n )) n > has been al- 
ready found in Lemma 4 of \ r 6j but does not apply in our case. Lndeed, we have 
no information on the expectation of the random variable j n . 
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The following Proposition is a fundamental consequence of (12) and says that 
for a "good choice" of the process (x n )n>i> we can choose a sequence (7 ra ) n >o 
such that the random step 7 becomes deterministic after an almost surely 
finite time. The existence of this finite time n\ is a significant property of our 
scheme. 

Proposition 5 Let f : [l,+oo) — > (0, +00) be a decreasing one-to-one con- 
tinuous function with lim fix) = and lira fix) = +oo ; and W a positive 

X^+CO X — >1 

function with values in [1, +00) satisfying (10). If 

Xn> (foW)(X n ), 

and if (7 n )n>o is subject to the condition 

n>\ f 1 (7n) 

where f^ 1 is the inverse of f , then there is an almost surely finite random 
variable n\ such that % = 7„ for every n > n\ . 



Proof. Let (8 n ) n > the sequence defined by 

Vn> -°- ^T^b (13) 

Since (7„)„>o is nonincreasing and 1// _1 is increasing on M + , then (9 n ) n > is 
nondecreasing and we have J2 n @nln < J2 n /-i" 7 ) < +°°- Moreover lim„^ n = 
1// _1 (0) = so that, by Proposition 3, we have 

lim^ n _ 1 W^(X n _ 1 ) = a.s. 

n 

Hence there is an a.s. finite random variable n\ such that 

Vn>m, W(X n ^) < r 1 ( 7 n-i) < r\ln) a.s. 
By the lower bound on Xn and the monotony of /, we have 

Vn > m, Xn-i > In a.s. 
which completes the proof. □ 



4 Convergence of empirical measures 

In this section, we give conditions for the almost sure tightness of >i 
and the weak convergence to an invariant distribution of (1). To this end, we 
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assume the existence of an almost surely finite random variable n\ such that 
for every n > n 1; 7„ = j n . In practice, this means that 7„ is defined by (9) 
with 7„ and Xn satisfying conditions of Proposition 5. Under this assumption 
the proofs are very close to those in ^ and jfjj]. 

From now on we make the assumption: 

Assumption 2 The deterministic sequences (7 n )n>o an d (n„) n >o satisfy 

^ jr it a — =°> 



——(a—^\ I is nonincreasinq and —— ( A—^] < +oo, (14) 



and there exists s G (1,2] such that 

( 1 / VnY\ . , X^fVnV ^ , 

— — — — is nomncreasmq and > — — — < +oo. (15) 

Remark 6 In "practice the above conditions on (7 n )n>o and (n„) n >i o,re not 
restrictive. Setting 7„ = n~ v , < p < 1 and r\ n = n~ q , q < 1, Assumption 2 
is satisfied if and only if 

. \ ( 2(s-l)\ . , f/2(s-l) 
(p,q)E 0,^ ) x (-oo, 1]U -,1 



4-1 A.s. tightness of empirical measures 



We begin with proving the almost surely tightness of ^ when we have 
a control on the scheme (X n ) n > . 

Theorem 7 We assume that (7 n )n>o o,nd (n„) n >o satisfy Assumption 2 and 
that there exists an almost surely finite random variable n\ such that 7„ = 7„ 
for every n>n\. Suppose that W is a positive function satisfying (10) and 



E 



n>1 



Vn 



E 



W(X n 



for some s G (1,2]. Then, 



E 



W(X n ) | | T n -x 



< +oo a.s., 



sup VniW) < +oo a.s. 

n>\ 



8 



Proof. Since W satisfies (10), there exist a > 0, (3 > and n > such that 



Vn > n , W{X n ) < 



W(X n ) - E W(X n+1 ) | T n 



7n+l« 



a 



Hence, for every n > uq V n\ + 1, 



n fe=raoVrti+l 

1 



< — E 

fc=n Vni+l ^ fcQ; 



(W(X fc _i) - E[W(X fc ) | ^fc-l]) + ^- 



It suffices to prove that 
1 ^Vk 



sup — 2-M^fc-i)-E[w(X fc )l^-il) a-*- 

n>l -«„ fc=1 7fc V L J/ 



An Abel transform, setting rj = 0, yields 



k=i 



ilk 



In 



fc=1 x Ik, 

and it follows from condition (14) and Proposition 3 applied with 6 n = 
-^-(A^) that 

T,^-( A -) W(X n ^)<+oo a.s. 

n>l H n\ lnJ + 

Applying Kronecker's lemma, we get 

1 n n 

limsup — ^-^(wiX^-WiXk)) <0 a.s. 

n n k=l 

It remains to prove that 
1 n n 

SU P TT E -f^W - ^\W(X k ) I J^-il) < +oo a. 

n>l -H n fe=1 7fc V L J/ 

We introduce the martingale (M n ) n >i defined by 



s. 



n , 

Vn > 1, M„ := ^ (W(X k ) - E[w(X k ) \F k . 1 



M := 0. 



By the Chow theorem (see |2|), the a.s. convergence of (M n ) n >i will follow 
from the a.s. convergence of 



E 



Tjr, 



E 



W(X n ) - E W{X n ) | T n _ x | T n _ x 



n>l ^ Hn^r, 

and the Kronecker lemma completes the proof. □ 



< +00 a.s. 



4-2 Identification of the limit 



We now prove that any weak limit of (^) n >o is an invariant distribution for 
the diffusion (1). We use the same method as Lamberton and Pages. By the 
Echeverria- Weiss theorem (see 0) it suffices to prove that lim n v%(Af) = for 
any twice continuously differentiable function / with compact support. The 
existence of the Lyapounov function V implies the regularity of the process 
(xt)t>o so that the Echeverria- Weiss applies -although b has not sublinear 
growth-. 

Proposition 8 Suppose that there exists K > such that 

Vn>l, \X n -X n ^\<K^Vv(X n ^)(l + \U n \), (16) 

and a function W satisfying (10), V = o{W) and sup n>1 ^(W) < +00. Then 
for every twice continuously differentiable function f with compact support, 

]imu*(Af) = a.s. 



The following Lemma is useful to prove this Proposition. 

Lemma 9 Under the assumptions of Proposition 8, for every bounded Lips- 
chitz continuous function f : M d — ► R we have 



1 » E 
lim — ^2vk — 



f{Xk) I Fk-i — f{Xk- 



a.s. 



n k=i 



Ik 



Proof. First, we prove that 



1 » E 

l TjfT,Vk- 

1±n k=i 



f\Xk)\J : k-l ~ f{Xk 



a.s. 



Ik 



(17) 



To this end, we introduce the martingale (M n )„>o defined by 



Vn>l, M n = £j^-(E[f(X k )\F k - 1 ]-f(X k )) and ,U n (). 

k=l k 
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We have 



(E[f(X k ) - /(X fc _0 | JS-i] + - f(X k ))\ 

and using (a + b) 2 < 2(a 2 + b 2 ), Jensen's inequality and / Lipschitz we get 



(m)oo<4$: 



E 



< 



(/(^-/(I^jVn-l 



Since s < 2 and (7„)„ is nonincreasing, the sequence (9 n ) n = (—( H Vn , — ) ) 

is nonincreasing and by (15) we have S n >i $n7« < +00. Moreover satisfies 
(10) and 7„ = 7„ for every n > ni, then the Proposition 3 applied with 7„ 
and n yields 

£ 0„7n^(X n _i) < +00 a.s. (19) 

n>noVni+l 

By (18), V = o(W) and (19) we obtain the almost sure convergence of the 
increasing process of (M n ) n >i. Thus the martingale converges almost surely. 
The Kronecker lemma gives (17). 



Finally we prove that 



1™ -^E -(/(**) -/(**-i)) = ° a - s -> 



n k=l 



Ik 



using Abel's transform, the boundedness of / and lim„ X^ =1 |A^| = 0. □ 



Proof of Proposition 8. By Taylor's formula applied to / between X„_i 
and X„ we have 



E 



f(X n ) I .F n -i] - /(X n _0 = %Af(X n ^) + hf n D 2 f{X k ^) • 6(X n _0 



+ E 



-^(^n-l, A n ) I JF rl _ 1 



, (20) 



with R 2 (x, y) = f(y) - f(x) - (Vf(x),y - x) - \D 2 f\x) ■ (y - x)® 2 . On the 
one hand, by the above lemma 



U n m ^E^( E /Wl^-i -/(X fe _ 1 ))=0 a.s. 
fe=i 7 
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and on the other hand we have, using that 7„ < 7„ and that D 2 f has compact 
support, 

in i n 

J2vklkD 2 f(X k ^)-b^(X k ^) < pV-^IUttE^ 

II n. l. _ i -£1 n. i. _ i 



k=i 



ln k=i 



and since (7 n ) n >o is decreasing to 0, we obtain 
1 n 

Mm J2vklkD 2 f(X k ^) • 6® 2 (X fc _0 = a.s. 



k=i 



From (20), (21) and (22), it follows that 

/ 1 n tj, r 

lim KKA/0 + TT E " E #2(^-1,^)1-^-1 
n V H n k=1 lk L 



(22) 



a.s. (23) 



We introduce the continuous bounded function 

r 2 (z,o) = ^ sup ID 2 /^)-^ 2 /^)!, 

^ zGR d ,|z-:r|<5 

which is nondecreasing in 5 and satisfies 

\/(x,y)ER 2d , \R 2 {x,y)\ <r 2 (x,\y - x\)\y - x\ 2 . 
Thus, from (23) and (16) it suffices to prove that 



n k=i 



Y,^V{X k ^\r 2 {X k _ l ,5 k {U k ))(l + \U k \ 2 )\r k ^ 



= a.s. (24) 



where 5 k (u) = \^ k b(X k ^i) + y/%a(X k ^ 1 )u\ 



Let u G W n and A > 0. It is clear that the sequence (S k (u)l{\x k _ 1 \<A}j 
converges almost surely to and thus 



k>i 



\imr 2 (X k _ 1 ,5 k (u))l { \ Xk _ 1 \<A} = a.s. 



Since 
1 



H, 



E%^(^fc-l)^2(^fc-l,4(M))(l + \u\ 2 )l{\X k ^\<A} 



n k=l 



< tf||r 2 ||oo(l + H 2 ), 



we have by the dominated convergence theorem 

1 



I f 

lim — V rj k V(X k -i) / r 2 (X k -i, 5 k (u))(l + |w| 2 )/x(dn)l { |^ fe _ 1 |<A} = a.s. 

(25) 
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{\X k ^\>A} 



where fi is the law of U\. On the other hand, we have 
1 n r 

lim — ^^y(X fe _ 1 )E[r 2 (X fc _ 1 ,4(^))(l + |^| 2 )|^-i 
k=i 

< (l+m)!!^!^ SVLP\V(X)/W(X)\SVLPV%{W), 

\x\>A n 

and letting A — > +00 and combining with (25) we obtain (24). □ 



5 Monotone and dissipative problems 



We now apply our results to monotone problems. In this section we assume 
that V is essentially quadratic but the drift b need not be globally Lipschitz. 

Assumption 3 The function V satisfies 

3CV>0, |W| 2 <CVV, and IpV^ := sup \\D 2 V\\ < +00. (26) 



Under this condition and Assumption 1, Mattingly, Stuart and Higham proved 
the geometric ergodicity of (1) when a is constant (see [9J] for details). We 
assume that a satisfies 

3C a > 0, 3a G (0, 1], Tr(CTCT*) < C a V l ~ a , (27) 

so that condition (6) is checked. 

We consider the Markov chain (X„) n > built by the recursive procedure (4) 
with the random step sequence 7 defined by 

7o = To, > 1, Tn = 9n{X n -i) (28) 

with g n : M d — > M.*^ defined by g n {x) = 7„ A x( x ) where x is a function on M d 
with value in 

The main result of this section is the following Theorem. 

Theorem 10 Let (t„)„>o and (i] n ) n >o satisfy Assumption 2. Suppose that 
there exist I > 1 and Cj > 1 such that |o(a;)| 2 < CbV l (x) and that \ satisfies 



Vx G 



C ^. W <, W <(_^)_^L_, (29) 
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with ( < 



25 



C b \\D*V\\ t 



■ , V > I ~ 1 an d $ e (0, oi). If (7ri)„>o satisfies 



Q_ 



(30) 



n>l 



and An 



2r 2(a - 5) , 

A v - J then 



aCjD^VlU KaC v C a 



• there exists a finite random variable n\ such that \/n > rt\, 7„ = 7„ 7 

• for every \<^f (whith s as in (15)), 

sup v%(exp(\V a f) < +oo a.s. 

and any weak limit of (uj^j > ^ is an invariant distribution for (1). 

Remark 11 The condition (30) is not restrictive. For example, it is satisfied 
if In < \a(ln~a (n) and p > a, or 7„ < X^(\n~^ 1+£ \n) for some e > and 
p < a. 

To prove this Theorem, it suffices essentially to check that the function W = 
exp(AV a ) satisfies condition (10) and the Assumptions of Theorem 7. This is 
the aim of Lemmas 12 and 13 respectively, which will be proved later. 

Lemma 12 Assume that 

VxeR d y(x)<( 25 ) V{X) 

where 5 G (0, a). Let A be as in Theorem 10. Then for every A < A there 
exists a > 0, P > 0, and n > such that for every n > n , 



E 



exp 



(\V a (X n+1 



J~ n 



exp(A\/ a (X r 



< 



7n+l 



-aexp(V a (X„)) +0. 



Lemma 13 Assume that there exists an almost sure finite random variable 
n\ such that % = j n for every n >n±. Let An. be as in Theorem 10. Then for 

every A < — the series 
s 



W Vn 



E 



ex V (XV a (X n )) - E exp(Ay a (X n )) | T n _ x \ T n _ x 



is almost surely finite. 
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Proof of Theorem 10. By Lemma 12 the function W = exp(\V a ) satisfies 
condition (10). We consider the function / defined on [1, +oo) by 

Vx>l, /(a;) = CA»lir5(a;). 

This is a decreasing one-to-one continuous function with lim f(x) = +oo 
and lim fix) = 0. We check that / o W = (V~ p and by (29) we have 
x(X n ) > (/ o W)(X n ). The inverse of / is the function f~ 1 defined by 

Vxe]0,+oo[, r\x) = exp(AC*aT*), (31) 

so that the condition (30) on 7„ is J2n>o j < +oo. The Proposition 5 
applied with / and W gives the existence of an almost surely finite random 
variable rt\ such that % = 7„ for every n>n\. 

By Lemma 12 the conditions of Theorem 7 are fulfilled and we have for every 
A < A /s 

sup z/^(exp(AV a ) J < +oo a.s. 

n>l V ' 

It remains to prove that any weak limit of (z^) n >i is an invariant distribution 
for the diffusion. By Subsection 4.2 and Proposition 8, it suffices to check (16). 
On the one hand, the definition of the algorithm yields 

\X n - X n _i\ < 7„|6(X n _i)| + yJ^a^Xn^Unl 
On the other hand, we have % = g n (X n -i) and 



g n (x)\b(x)\ < ^Jx)^(x)\b{x)\ < ^J^^j^L-VVix), (32) 

thus 7n|6(X n _!)| < y/^ftS/WDtVWnVViX^). Since Tr(aa*) < C c V x -\ 
a > and V > 1 then there exists C > such that 



\X n -X n _!| < Cfay/ViXn-Ml + |C/ n |), 
and this, combined with 7„ < 7„, implies (16). □ 

Remark 14 TTie control of %\b(X n ^i) \ given by (32) is an important property 
of our scheme and will be often used throughout the section. 

For the proof of Lemmas 12 and 13 we will need the following consquence of 
conditions (7) and (8) on U 1 . 

Lemma 15 There exists K > such that \/6 e [0, r],\/he (0, 1), Vv e R d , 

h k , 



E 



exp(yh(v,U!) + hOlU^ 2 ) < exp(j — ~\v\ 2 + Kh 
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Proof of Lemma 15. By Holder's inequality, we have 



E 



exp(v^(u,E/i) + h9\U 1 \ 2 ) 



< E 



exp 



Vh 
l-h 



[v,U x ) 



l-h 



x E 



exp(0|l/i 



Since the random variable Ui is a generalized Gaussian, we have 



E 



exp 



1 - h 



< 



exp 



h k , 



[l-h) 2 2 



— \v\ 



Since Ui satisfies (8) and 9 < r, E exp(0|[/i| 2 ) 



< +oo. By setting 



/\' log( 2 
the formula is established. □ 



exp (r\Ui 



Proof of Lemma 12. 

We recall that a e]0, 1]. By concavity of the function (x i— > :r a ) we have 

V a (X n+1 ) - V a (X n ) < a\/ a - 1 (X„)(\/(X„ +1 ) - \/(X„)). (33) 
The Taylor formula applied to V between X n and X n+1 yields 

V(X n+1 ) < V(X n ) + (W(X„), AX n+1 ) + ip|AX„ +1 | 2 , (34) 

where p = ||.D 2 y||oo- 

From the stability condition (5) and AX n+ i = 7„ + i&(X n ) + ^% + i<r(X n )U n+ i, 
there exist a > and /? > such that 

(VV(X n ), AX n+1 ) < -a% +1 V(X n ) + (3% +l + A^ +1 (X n , U n+1 ), (35) 

with the notation 

a!2i(x,m) = yj g n+1 (x) (W(x) , a(x)u) . 



On the other hand we write 



h.^li{x,u) = 2(g n+1 (x)y /2 (b(x),a(x)u) + g n+1 (x)Tr(aa*)(x)\u\ 2 , 
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so that 

|AX n+1 | 2 < 7n + il Wl* + A£i(*», U n+1 ). 
From (32) it follows that 



25 



AX n+1 \ 2 < -% +1 V(X n ) + A%(X n ,U n+1 ). 



(36) 



Combining (33), (34), (35) and (36) gives 
V a (X n+1 ) < V a (X n ) - a(a - 5)% +1 V a (X n ) + a(3% +1 



+ aV a - 1 (X n )(A^ +1 (X n ,U n+1 ) + ^A {2) +1 (X n ,U n+1 )). (37) 



Let A G (0, A ). From (37) we deduce that for every n > 
E 



exp(\V a (X n+1 )) \T n 

< exp(V a (X n ) - Xa(a - 5)% +1 V a (X n ) + \a(3% + ^ Y n+1 (38) 



where 



Yn+l = E 



exp(Aa\/ a - 1 (X„)(Al 1 | 1 (X„, U n+l ) + ^A {2) +1 (X n , U n+1 ))) | F, 



We fix ra such that 7„ < 1 which will ensure <7 n (x) < 1 for every x G M. d , and 
define by 



4>n{x) = E 



exp(Aa\/ a - 1 (x)(A( 1 )( a ;,f/ 1 ) + ^(x,^)) 



so that F n+ i = (f) n+1 (X n ). Setting v = XaV a 1 (x)a*(x)(vV(x) + pg n (x)b(x 
we obtain by the definition of and 



(x) = E 



expl^/g^xXvM + ^V a - 1 (x)g n (x)Tr(aa*)(x)\U 1 \ 2 



Since Tr(aa*) < a and A < A < we are able to apply Lemma 15 

with 9 = Xap c° an( j ft, — g n (x) which yields the existence of K > such that 



4> n (x) < expf 9n(yX ] ^-\v\ 2 + Kg n (x)\ 
\l-g n {x)2 J 



(39) 



It remains to handle |t>| 2 . From (Vl^ 2 < CyV and (VV,b) < f3 we obtain 
M 2 < X 2 a 2 V 2a - 2 (x)Tr(aa*)(x){C v V(x) + 2pf3g n (x) + p 2 g 2 n (x)\b(x)\ 2 ) 
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From (27), (32) and V > 1 we have 

\v\ 2 < X 2 a 2 C a V a - 1 (x)(c v V(x) + Cg n (x)V(xj), 

with C = 2p(5 + j3). In the following inequalities, the letter C is used to denote 
a positive constant. Since 



9 " {x) - fcW + 7 i&L <*(*)+ *2<*> 



1 - 0n(aO 



1 - 5- n (x) 



1 7no 



where no = min{n; 7„ < 1}, it follows that 



9n{X) 



1 - 9n(x) 



v\ 2 < X 2 a 2 C v C a g n (x)V a (x) + Cg 2 n (x)V a (x). 



(40) 



Combining (40) with (39) yields 



<l> n (x)<exp(\ 2 a 2 C v C a -g n (x)V%x)+C&(x)V a (x) + Kg n (x)), (11) 



and this inequality is true for every n > n . 

t + - r r\ \ Kci^CyCjj 2(a-S) 

Let a = a{a — 6) — A . Since A < A < — , we have a > 0, and 

2 /taGyCo- 

combining (41) with (38) we get for every n > no, 



E 



exp(XV a (X n+1 )) | < ex V (w a {X n ) - Xa% +1 V a (X n ) 



+ Cf n+1 V a (X n ) + K% +1 ), 



where K = Xaf3 + K. Setting n' = min{n; j n < Aa/(2C)} and a = a/2 we 
have for every n > n V n' , 



E 



exp(XV a (X n+1 )) | F n ] < exp(xV a (X n ) - Xa% +1 V a (X n ) + K% + \ 



With the notation (3 = aexp(K/a) and n' ' = min{n; 7„ < l/a} we have by 
convexity of the exponential function: for every n > n V n' V n' ', 



E 



exp(A\/ a (X ?1 



< 



1 - «7n + i) exp(XV a (X n )) + fa n+1 , (42) 



which is the desired conclusion. □ 
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Proof of Lemma 13. Let W = exp with A < Xq/s. As s > 1, we have 

by convexity 



W(X n ) - E W(X n ) | T n _ x 



W{X n ) - W{X, 



n—1. 



+ 



E 



W(X n ) - W{X n ^) I T n ^ 



and by Jensen's inequality 



E 



W{X n )-W{X n „ x )\F n - 1 <E W(X n ) - W{X n ^) \T n „ x 



Thus it suffices to prove 



Vr, 



n>l v " 1 - ln ' n 



E 



W(X n )-W(X n ^) \F n _ x 



< +00 a.s. 



Taylor's formula applied to the convex function (x t— > exp(Ax)J between 
V a (X n ) and V a (X n ^) yields 

\W(X n )-W(X n ^)\ < X(exp(XV a (X n ))+exp(XV a (X n ^)))\AV a (X n )\, (43) 

where AV a (X n ) = V a (X n ) - V a (X n ^). As in the proof of Theorem 10, from 
(32) and (27) we deduce that 

\X n - X n _x| < C^WiX^)^ + \U n \), 

and by Lemma 2. (a) of |5J| we get 

\V a (X n ) - V a (X n ^)\ < C^(W(X n ^)) 2aV1 (l + \U n \ 2aS/1 ). (44) 



To simplify notation, set A n ^\ = (V V(X n -i) ) and B n — 1 + [Z7 n 
Plugging (44) into (43) we obtain 



2aVl 



2aVl 



|W(X n ) - W(X n _a)| < XC^[W(X n ) + V^-OUn-iS 



and 



E 



\AW{X n )\ s \T n ^ < \'C'ri 2 (W 8 (X 1 ^ x )Al_ l K[B' n \r^ 

+ A s n _ l E\w s (X n )B s n \F n _ 1 



(45) 



By Young's inequality for any e > 

1 



E 



W*(X n )B a n \F, 



n-l 



< 



l + e 



E 



W^ l+e \X n )\T n - 1 



l + e 



-K F 
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with K s = e\b^ 1+£ V £ I F n _A . We choose e such that As(l + e) < A and we 
get from Lemma 12 that for every n > n , 

1 



E 



W s (X n )B s n | .F n -i] < -_E[exp(A S (l + e)V a (X n j) \ T n _ x 



+ 



1 + e 



< r ^(exp(As(l + £)\/ a (X n _ 1 )) +^ n + X ££ ), 
Combining this with (45) we obtain 



E\\AW(X n )\ s \T n < \ s C s Yj 2 ( W s (X n _i)A 8 n _- i E[B%\ 

+ ^^W S(1+e) (^n-l)^l + C £ An-l)- 



/ . — \2aVl 

Keeping in mind that A n _ x = ( \/V(X n _i)\ one checks that there exists 
A G (As(l + e), A ) and K > such that 



E 



iw(x„)-^(x n _ 1 )n^„_ 1 



<K 7 : /2 exp(A\/ a (X n _ 1 )). 



Consequently, it remains to prove that 



E 



n>] 



'exp(A\/ a (X n _ 



i) < +oo a.s. 



(46) 



We consider the nonincreasing sequence (9 n )n>i — (h^=) ) >1 - F rom 
(14) and 7„ = 7„ for every n > ni, we can apply the Proposition 3 with 7„, 
# n and = exp(\V a ) which gives (46). □ 



6 Dissipative Hamiltonian systems 



In this section, we consider a stochastic differential system of the type 

dq t = d p H(q t ,pt)dt, ^ 
dp t = -d q H(q t ,p t )dt - F(q t ,p t )d p H(q t ,p t )dt + c(q t ,p t )dW t , 

with (q(0),p(0)) = (qo,Po) £ M. 2d . The process (Wt)t>o is a (/-dimensional 
Brownian motion and c is continuous on R 2d with values in the set of d x d 
matrices. The Hamiltonian H is of class C 2 on R 2d with real values and the 
function F is of class C 2 on R 2d with values in the set of d x d matrices. 
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We write this system in the abstract form (1) where 



x 




( 



b(x) 



d p H(x) 



\-d q H(x) - F(x)d p H( 



c(x) 



X 



f h{x) 
K b 2 (x) / 



and oix 



We recall that we work always under Assumption 1. The existence of a Lya- 
pounov function V is a natural hypothesis for dissipative Hamiltonian systems, 
and in many cases we can determine V using the Hamiltonian H. For exam- 
ple, for the Langevin equation (equation (47) with F(x) = 7 > 0, c(x) = c 
invertible and H(q,p) = ^- + g{q) with g £ C°°(M d ; M) a polynomial function 
growing at infinity like \q\ 21 , I > 1), the Lyapounov function is defined for 
every x = (q,p) £ R 2d by V(x) = H(x) + | (p,q) + ^\q\ 2 + 1 (see 0). 

In this section we assume that: 



Assumption 4 The function V satisfies 

3CV > 0, \d p V\ 2 < C V V and sup ||fi£,F(g,p)|| < +00. 



(4J 



Typical Lyapounov function of Hamiltonian systems may have arbitrary poly- 
nomial growth with respect to q but are essentially quadratic with respect to 
p. So in such a framework the following assumption is natural 

Tr(a* (WfV) = Tr(c*(d p V) m c) < CvVTi(c*c), 

and 

sup Tr(cr* D 2 Va)(x) = sup Tr(c*d 2 p Vc)(x) < p sup Tr(c*c)(x), 

where p = sup^ q ^ m 2d\d 2 p V(q,p)\. Thus condition (6) about o is satisfied as 
soon as 

3CV > 0, a £]0, 1], Tr(cc*) = Tr((xa*) < C^V 1 " 1 . (49) 

These assumptions are very weak and are satisfied by a large class of examples 
derived from perturbed Hamiltonian systems. For a general model for the 
Hamiltonian and many examples (essentially multidimensional oscillators) we 
refer to (page 10 for hypothesis on the Hamiltonian). 

Our scheme (X„) n > is built applying the recursive procedure (4) with the 
random step sequence 7 defined by 

7o = 7o, Vn > 1, 7„ = g n (X n -i) (50) 
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with g n {x) = 7n A Xn{%) where Xn '■ K 2d — ► R+- Throughout the section, we 
consider the following function ip n (x) : M? d — > R defined by 

Vx6l d , ^„(x) = sup ||£>V(g,p)|| Vl. (51) 

?e(g,g+7„6i(x)) 



(52) 



We introduce the notation X n = (Q n , -Pn) so that 

Qn+l = Qn + 7n+l^l 

P n+ i = P n + %+ib 2 {X n ) + y/% +1 c(X n )U n+1 , 
and (<5o,-Po) = (<7o,Po)- Remark that (Q„)„>o is (J r n ) n > -predictable. 
The principal result is the following Theorem. 

Theorem 16 Let (7„)„>i and (i] n ) n >i satisfy Assumption 2. Suppose that 
there exist I > 1 and > 1 such that ip n (x)\b(x)\ 2 < Cf,V l (x) and that x 
satisfies 

VX€W ' C^W<X„W< ^ff 2vl) . (53) 
( < p > I — 1 and 5 G (0, a/4). If (7„) ra >o satisfies 

a — — \ 

^7 n exp(-AC^7« P ) < +oo, (54) 

n>l 

r 2(a - 45) , 
anrf A ° = n \\pa T7\\ A n n then 

• there exists an a.s. finite random variable n\ such that Vn > n\, 7„ = 7„ 7 

• for every A < — (whith s as in (15)), 



sup^(exp(AV™)J < +oo a.s. 

and any weak limit of {v^ is an invariant distribution for (1). 

The proof of this Theorem is essentially the same as the proof of Theorem 10. 
Lemma 17 gives condition on x so that W = exp(A^ a ) satisfy (10) and 
Lemma 18 allows to apply Theorem 7. 



Lemma 17 Assume that 

Wx e K 2d , Xn{x) < 



2 d / 2SV(X) 



^(z)(|&(z)| 2 Vl)' 
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where 5 G (0, a/A). Let Ao be as in Theorem 16. Then for every A < Ao there 
exist a > 0, (3 > 0, and n > such that for every n > n , 



E 



exp(AV-(X n+1 )) | jrl -exp(\V a (X n 



7n+l 



< -aexp(\V a (X n )) +0. 



Lemma 18 Assume that there exists an almost sure finite random variable 
rt\ such that 7„ = j n for every n > n + 1. Let A be as in Theorem 16. Then 

for every A < — the series 
s 



]T ( tt 2 - ) E exp(A\/ a (X n )) - E[exp(A\/ a (X n )) | .Fn-il ' I ^„-i 
zs almost surely finite. 

A first property of our scheme is given by the following Lemma. 
Lemma 19 If 5 < a and 



G M 2c \ Xn(a:) < , — K —L r , (55) 

^(x)(|6(x)Pvl)' 



t/ien /or every x = (q, p) G 

V(q + g n (x)h(x),p) < (l + J^JgJ^))V(x) + g n (x)(3. 

Proof. By the Taylor's formula we obtain 



V(q + g^xMx)^) - V(x) < g n (x) (d q V (x) , 6i(x)> 

1 
2 



+ 7iKV(q n ,p)\\\9n(x)b 1 (x)\ 2 , (56) 



where q n G (<?, q + g n (x)bi(x)). Since o„(x) = 7„ A Xn(^) we have 

<£(*)|&i(s)| 2 < i/ B (x)xn(a:)|6i(x)| 2 < o„(x)^^. (57) 

Moreover, \\d 2 qq V(q n ,p)\\ < \\D 2 V{q n ,p)\\ < ip n {x) and by (56) 

Viq + g^xMx)^) - V(x) < g n (x)(d q V(x),b 1 (x)) + g n (x)5V(x). (58) 

Writing (d q V(x),b 1 (x)) = (W,b)(x) — (d p V,b 2 )(x) and using the stability 
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condition (5) we get 

Viq + gnixMxlp) - V(x) < g n {x)(p - aV(x) - (d p V(x), b 2 (x))) 

+ g n (x)5V(x). 

Since 5 < a and |<9 P V| 2 < C V V we have 

V{q + g n (x)b!(x),p) - V(x) < g n (x)Jc^W(x)\b 2 (x)\ + g n (x)/3, 
and if \b 2 (x)\ < -fi&-y/V(x) then 

V(q + g n {x)b 1 (x),p)-V(x) < sJg~Jx)^25C^V{x) + g n {x)(3, 
else VV(x) < y^d\b 2 (x)\ and 

V(q + g n (x)b!(x),p) - V(x) < g n {x)yj g n (x) h (x)\ 2 + g n {x)(3, 

< \/ 9n(x)]J^Xn(x)\b 2 (x)\ 2 + g n (x)/3. 

From (55) we deduce that 

V(q + g n (x)b 1 (x),p)-V(x) < ^Jg~{x)^25C^V{x) + g n (x)P, 
and the Lemma is proved. □ 

Proof of Lemma 17. First, remark that by the concavity of the function 

(x i— > x a ) we have 

V a (X n+1 ) - V a (X n ) < aV a -\X n ){v{X n+1 ) - V(xSj, (59) 

and that 

V(X n+1 ) - V(X n ) = V(X n+1 ) - V(Q n+1 , P n ) + V(Q n+1 , P n ) - V(X n ). 

In the proof of Lemma 19 we proved (58) i.e. 

V(Q n+1 ,P n ) - V(X n ) < % +1 (d q V(X n ),b 1 (X n )) +% +1 8V(X n ). (60) 

We now study V(X n+ i) — V{Q n+ \, P n ). We apply Taylor's formula to V which 
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gives 

V(X n+1 ) -V(Q n+1 ,P n ) < (d p V(Q n+1 ,P n ),AP n+1 )+ 

1 

- sup 

^ pe(P„,P n +i) 

On the one hand, we have 



- snp \\d 2 pp V(Q n+1 ,p)\\\AP n+1 \ 2 . (61) 



(d p V(Q n+1 , P n ), AP n+1 ) = % +1 (d p V(X n ), b 2 (X n )) 

+ % + i(d P V(Q n+ i, Pn) - d p V(X n ), b 2 {X n )) 
+ \fn/n+i(d p V(Q n+1 , P n ), c(X n )U n+1 ), 

and using 

\d p V(Q n+1 ,P n )-d p V(X n )\ < \\d 2 p V(q,P n )\\\AQ n+1 \, 

<7n + ipV(g,P„)|||6 1 (X n )|, 

where q G (Q n , Q n +i) we obtain 

(d p V(Q n+1 ,P n ), AP n+1 ) < % +1 (d p V(X n ),b 2 (X n )) 

+ f n+1 \\D 2 V(q,P n )\\\b 1 (X n )\\b 2 (X n )\ 



+ yJ%+i(d p V(Q n+1 ,P n ),c(X n )U n+1 ). 
Since 7„ +1 = 7 n+i A Xn+i{X n ) we have 

7n + l < Xn + 1 (X n ) < iin^pi,^,.^ ( 62 ) 

sup \\D 2 V(q,P n )\\(\b(X n )\ 2 V lj 

q&(Qn,Q n +l) 

and from |6 1 (X n )||6 2 (X n )| < \\b(X n )\ 2 we obtain 

(WQn+1, Pn), APn+l) < 7n+l («9 p V(X n ) , b 2 (X n )) + 7„ +1 5\/(X n ) 

+ J%7i(d P V(Q n+1 , P n ), c(X n )U n+1 ). (63) 
On the other hand, setting p = su.p xm2 d\\d pp V (x)\\ and using (52) we have 
sup \\d 2 pp V(Q n+1 ,p)\\\AP n+1 \ 2 

p£(P„,P n +l) 

<2f n+1 sup \\D 2 V(Q n+1 ,p)\\\b 2 (X n )\ 2 

p£(Pn,Pn+l) 

+ 2% +1 pTr(cc*)(X n )\U n+1 \ 2 . 

By the definition of % + i it follows that 

sup \\d 2 pp V(Q n ,p)\\\AP n+1 \ 2 < 4% +1 5V(X n ) 

pe(P„,P„+i) 

+ 27 n+lP Tr(cc*)(X n )|f/ n+1 | 2 . (64) 



25 



Finally, combining (61) with (63) and (64) we obtain 



V(X n+1 )-V(Q n+1 ,P n ) 

< %+i(d p V(X n ),b 2 (Xn)) + 35% +1 V(X n ) +Y n+1 , (65) 

where 



Y n +i = Jn/n+i(dpV(Q n+ i,P n ),c(X n )U n+ i) + p>y n+1 Tr(cc*)(X n )\U n+1 \ . 



From (60) and (65) we have 

V(X n+1 ) - V(X n ) < 7„+i(W, b)(X n ) + 45% +1 V(X n ) + Y n+1 , 

and by the stability condition (5) there exists a > such that 

V(X n+1 ) < V(X n ) - a% +1 V(X n ) + 45% +1 V(X n ) + f3% +1 + Y n+1 , 
= V(X n ) -(a- 45)% +1 V(X n ) + p% +1 + Y n+1 . 

By (59) and V > 1 we get (using that V 0-1 < 1) 

V a (X n+1 ) < V a (X n ) - a(a - 45)% +1 V a (X n ) + a[3% +1 + aV a -\X n )Y n+1 . 



Let A G (0,A ). Denoting 



J n+1 



E 



exp(aA\/ a - 1 (X„)y; +1 )|^ r) 



we have 
E 



exp(\V a (X n+1 ))\F n 

< exp(\V a (X n ) - a\(a - 45)% +1 V a (X n ) + a\f3% +1 ) Z n+1 . (66) 



It remains to study Z n . We define <f> n (x) by 



<f) n {x) = E 



exv(y/iUx)(v, U x ) + \apg n {x)V a -\x) Tv{cc'){x)\U 1 \ 2 ) 



(67) 



with v = XaV a 1 (x)c*(x)d p V (<? + ff„(a;)6i(a;),p), so that Z n+i = n+1 (X n ). 
Using Tr (cc*) < CVV 1 -" we have 



(x) < E 



exp( v /^r)(w, Ui) + Aap5f n (x)C (T |L r i| 2 ) 



Let no = min{n > 0;7„ < 1}. Since A < A < -^r, we are able to apply 
lemma 15 with 9 = XapC a and h = g n (x) which gives the existence of K > 
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such that for every n > n 



<f>n(x) < expf 9n{x) ^ v ]2 + Kg n {x) 



J - g n (x) 2 
Moreover, it follows from \d p V\ < CyV that 



(68) 



\v\ 2 < \ 2 a 2 C a V a -\x)\d p V{q + g n {x)h x {x), V )\\ 
< X 2 a 2 C a C v V a - 1 (x)V(q + g n (x)b 1 (x),p), 

The Lemma 19 gives 

M 2 < \ 2 a 2 C a C v V a {x) + Cy/g^(x) V a (x) + g n (x)(3. 

In the same manner as in the proof of Lemma 12 there exists C > and 
K > such that for every n> n 

ct>n(x) < exp(^X 2 a 2 C a C v g n (x)V a (x) + Cg 3 J 2 (x)V a (x) + Kg n (x) 

then from (66) we have 



E 



exp(\V a (X n+1 )) \F n ] <exp(XV a (X n ) 



K . 



aX(a -45- -XaC a C v )% +1 V a (X n 



Let a = a{a — 45 — %XaC a C v ). Since A < A < , , , , 



+ CfJ^V a {X n ) + K% +l ). 
2(a - 45) 



we have a > 0. 



Setting n' = min{n; < aAa/(2C)} and a = (Xaa)/2 we have for every 
n > no V n' 



E 



exp(XV a (X n+1 )) | F n ] < exp(XV a (X n ) - a% +1 V a (X n ) + C% +1 ), 



which proves the lemma (by the convexity of the exponential). □ 



Proof of Lemma 18. Let W = exp(AV a ) with A < X /s. We recall that Q Ti 
is T n -\ measurable. Since s > 1, the convexity of (x h- > x s ) implies that 



E 



W{X n )-^[w{X n )\T n „ 1 



| F n-l 

< 2 S E 



|W(X n )-^(Qn,P„-l)N^n-l 



First we prove that 

\V a (X n ) - V a (Q n ,P n ^)\ < C^r n A n _ x B n 



(69) 
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with 



A n -!= [VV(Q n ,P n ^ 
B n = l + \U n \™\ 



(2a-l)+ 



(2oVl) 



Since AP n = %b 2 (X n _ 1 ) + y/%c{X n ^)U n and Tr(cc*) < C a V 1 ~ a , we have 

|AP n | < 7n|fc 2 (^n-l)| + ^ n C a (VV{X n ^)f' a \U n \. 

Using % < Xn(X n -i) < iff^pvi we obtain 



|AP n | < ^V^WiX^) + j%c a (yv(x, 

<C^%W(X n ^)(l + \U n \). 



n-l 



l-o. 



(70) 



From |SpV^| 2 < CyV we deduce that |<9 p y a | < a^/C^V a 2 so that the appli- 
cation (p 1— > V™(g,p)) is Lipschitz for every a < |. Hence, if a < | we have 

(69) with A n _i = >A%Xn-i) and B n = 1 + |C/ n |. If a > |, by Taylor's formula 
we have 

V a (X n ) - V a (Q n ,P n ^) = (d p V a (Q n ,p n ),AP n ), 

< aJc^(Vv(Q n ,p n )f a ~ l \AP n l (71) 

with p n G (P n -i, P n ) and since 2a — 1 < 1 

(v / y(Q n ,p n )) 2a-1 < (v^(g„,P„_i) + C\AP n \) 2a ~\ 

< (W(Q n ,P n ^)) 2a ~ 1 + C\AP n \ 2a -\ (72) 

Plugging (72) in (71) we get 
\V a (X n )-V a (Q n ,P n ^)\ 

< c v ^( v / i 7 (g„,p„-i)) 2 " 1 v / i 7 (x n _ 1 )(i + \u n \) 

/ / — \ 2a / \ 2a 

+ c 1 :(W(x n _ 1 )) (i + \u n \) 

Since V > 1 and 2a > 1, it is easy to check that (69) is satisfied with A n _i = 
(W(Q n ,P n „ l )f a ~ 1 (VV(X n ^)) 2a and B n = 1 + \U n \ 2a . 

By (69) and Taylor's formula applied to the convex function (x 1— > exp(Ax)) 
between \/ a (X„) and V a ((5n, -Pn-i) we have 

\W(X n ) - W(Q n ,P n ^))\ < \C^u(w{X n ) + W(Q n ,P n ^))A n ^B n , 
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and then 



E 



\W(X n ) - W(Q n , P„_!)| s | T n - X ] < X'C'-f n /2 K-i^[W(X n )B' n | T n - X 

+ \ s C s Yj 2 K-lW S {Qn,Pn-l)nB s x ]. (73) 



As in the proof of Lemma 13 we prove that for every e > there exists C e > 
such that 



E 



W\X n )B s n | F n _ x \ < y^T s exp(As(l + e)V a (X n „i) ) + C £ . (74) 



To complete the proof we apply Lemma 19 which gives 



V(Q n ,P n ^) < (1 + p8C v ^ n )V{X n - X ) +j n p, 
and the concavity of (x h- > x a ) implies 



^ a (Qn,Pn-i) < 1 + aJ25C v J% )V a {X n _ x ) +%ap. 



There exists n > such that for every n > n , \s(l + a^25Cv y / ?: h) < A < A , 
and thus there exists K > such that 



W s (Q n ,P n ^)<Kexp(\V a (X, 



n—l, 



Plugging this and (74) in (73) and using the condition (15) and Lemma 3 we 
obtain the result. □ 



7 Numerical experiments 



The aim of this section is to validate our scheme numerically. We consider 
two problems: the Lorenz equations under external random excitation and a 
perturbed Hamiltonian system, which illustrate results in Sections 4 and 5 
respectively. In both cases, we compute v^{f) f° r a given function / using 
our scheme and we compare it with E f(X£) where (Xjf ) is a discretization 
scheme with constant step h (an Euler scheme or an implicit Euler scheme). 
The approximation of E f{X£) is given by a Monte-Carlo procedure with 
10000 paths. We give a representation of the stochastic sequence (7 n )„>o in 
Fig. 2 and 5. 



The programs are in C using BLAS/LAPACK (see http://www.netlib.org) 
for linear algebra routine and the GSL library (see http://www.gnu.org). 
In particular, the approximation of the fixed point needed in the implicit 
Euler scheme is done by the function gsl_multiroot_solver. The random 
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generator is a Mersenne twister generator of period 2 19937 — 1 taken from 
http : //www. math. sci . hiroshima-u. ac . jp/~m-mat/MT/emt .html 

All simulations are achieved using a Gaussian white noise for (U n ) n >i. The 
deterministic part 7„ of the implemented step sequence is j n = 7 n~ 1//3 and 
the weight sequence used is (r) n ) n >i = ( r y n )n>i- These choices are motivated 
by the study of the rate of convergence (see [7|). 



7.1 Lorenz equations 



It is a dissipative problem which is related to Section 4. The equations are 

dx t = 10{y t - x t ) dt + dW t \ 



dy t = (28x t -y t - x t z t ) dt + dW i 



t ! 



dz t = (x t y t - (8/3)z t ) dt 

and a Lyapounov function for this system is V(u) = \u\ 2 + 1. The function x 
used for simulations is defined for every u E M 3 by x{ u ) — i^pvi • 

The stochastic step sequence used for our scheme is thus 

/ 2V(X n ^) 



7o = 7o, and Vn > 1, 7 n = (y n ^ 



A 



V|&pQ-i)l 2 viy 



(75) 



The weight sequence (r) n ) n >i is equal to (7 n ) n >i and we compute for f(x) 
\x\ 2 and n < 10 7 



i^k=i k 3 fc=i 



(76) 



The result is given by the figure 1. The scheme seems to have a better be- 
900 




2e+06 4e+06 6e+06 8e+06 le+07 



Fig. 1. One path of (v2(f)) 



Kn<10 7 



for different value of 70. 
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haviour when 70 is equals to 2~ 4 or 2~ 5 . For bigger values of 70, the rate of 
convergence is poor but the Lorenz problem is a difficult numerical problem 
and the parameter 70 is hard to fix. Other numerical methods have the same 
problem. The important point to note here is that the scheme does not explode 
(for any 70) and appears convergent to the same limit. 

Figure 2 gives a representation of the stochastic step sequence (7 n )n>i when 
7o = 0.5. We show that the bigger n is and the less the stochastic part x{X n -x) 
is used. For this path, after 20 000 iterations we have % = 7 n (at least until 
n = 10 7 ). Moreover before the 20 000th iteration the event {x(X n -i) < 7 n } 
occurs only 924 times (4.62% of time). 




5000 10000 15000 20000 



Fig. 2. Stochastic step sequence (7 n )n>i- 



We compare our results with the approximation of E f(X^) where (X^) is a 
regular Euler scheme (figure 3(a)) or a implicit Euler scheme (figure 3(b)). We 
represent the results only for h < 2 -6 because for bigger values the empirical 
expectation (based on 10 000 paths) explodes whith the regular Euler scheme. 
For the implicit scheme the expectation remains bounded but the behaviour 
is very poor when h < 2~ 8 . The parameters h, T and the number of paths 
used for the Monte-Carlo procedure are hard to fix. 

For the implicit Euler scheme (figure 3(b)), the jump between h = 2~ 8 and h = 
2~ 9 is due to the fact that the scheme remains trapped in the neighborhood of 
only one attractor (Lorenz equation has two attractors). This behavior does 
not occur with the regular Euler scheme and with our scheme. 



7.2 Perturbed Hamiltonian system 



The second example is a perturbed Hamiltonian system derived from a multi- 
dimensional linear oscillator under external random excitation. It is a 3-DOF 
(degree of freedom) system studied by Ibrahim and Li (see |3]) and Soize (see 
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900 




(a) Euler scheme: X^ +lh = X^ h + hb(X^ h ) + VhaU k+1 



900 




(b) Implicit Euler scheme: X^ +lh = X^ h + hb(X^ +lh ) + V~haU k+ i 

Fig. 3. Computation of E[/(X^j] by a Monte-Carlo procedure on 10000 paths and 
for T = 5 



[HI chap. XIII. 6). We have thus the following equati 



ion m 



dq t = d p H(q t ,p t ) dt, 

dy t = -d q H(q t ,p t ) dt - f D d p H (q t , p t ) dt + g S dW t 



where H(q t ,p t ) = \{M(q) 1 p,p) + \{K Q q,q) and 

Ann n \ 



D = S 



U 0^ 


yO Oy 



Kn 



1.3 
0.154 
0.196 



g = 0.5, f = 0.9965, 
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and 



M{q) 



1.3 t>2 + 0.3 t>3 

v 2 + 0.3 u§ + 2w 2 + 0.314 v 2 v 3 + v 3 + 0.0375 

^3 ^2^3 + ^3 + 0.0375 < ,, 



witht> 2 (g) = —1.61(0.375^2+93) and^s(g) = —1.61(72. This numerical example 
is taken from (page 257-264). This is the first damping model case with 
the external excitation applied to DOF 1 and the system parameter equal to 
0.7. In this case we have an analytic expression of the density of the invariant 
measure and we can calculate the mean-square response for the DOF 1. We 
consider the function f 1 : (q, p) \— > q\ and we have 



fx(x)u(dx) 

JR 6 



0.0965. 



The stochastic sequence used in the following simulations is defined by 7 = 7o 
and Vn > 1 

? „ = ( 70 ^3) A ( _i_ ). 

The results for different value of 70 are given in figure 4. The convergence seems 
better when 70 is big. Our scheme behaves very well and a representation of 
the stochastic step sequence (7„)„>i is given in figure 5. 




200000 400000 600000 800000 le+06 



Fig. 4. One path of (*#(/)) 



Kn<10 6 



for different value of 70. 



We do not represent the approximation of E f(X^) where (X^) is the ex- 
plicit Euler scheme because the empirical expectation (based on 10 000 paths) 
explodes for h < 2~ 3 . 



Figure 6 gives results using the approximation of E f(X h 
implicit Euler scheme. 



where (X£) is the 
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1000 1200 1400 



Fig. 5. One representation of the stochastic step sequence (7 ra ) n >i- 



0.12 
0.11 
0.1 
0.09 
0.08 
0.07 
0.06 



III 


h = 2~ 3 

h = 2- 4 

h = 2~ 5 




h = 2- 6 








Sill 



Fig. 6. Computation of E[/(X^)] by a Monte-Carlo procedure on 10 000 paths and 
for T = 5 where is a implicit Euler scheme. 
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